Dataset statistics
| Number of variables | 9 |
|---|---|
| Number of observations | 5693 |
| Missing cells | 0 |
| Missing cells (%) | 0.0% |
| Duplicate rows | 0 |
| Duplicate rows (%) | 0.0% |
| Total size in memory | 400.4 KiB |
| Average record size in memory | 72.0 B |
Variable types
| Numeric | 9 |
|---|
gross_revenue is highly correlated with qtt_invoices and 2 other fields | High correlation |
recency_days is highly correlated with qtt_invoices | High correlation |
qtt_invoices is highly correlated with gross_revenue and 4 other fields | High correlation |
unique_products is highly correlated with gross_revenue and 1 other fields | High correlation |
unique_items is highly correlated with gross_revenue and 3 other fields | High correlation |
daily_purchase_rate is highly correlated with qtt_invoices and 1 other fields | High correlation |
total_prod_returned is highly correlated with qtt_invoices | High correlation |
gross_revenue is highly correlated with qtt_invoices and 1 other fields | High correlation |
qtt_invoices is highly correlated with gross_revenue and 1 other fields | High correlation |
unique_items is highly correlated with gross_revenue and 1 other fields | High correlation |
gross_revenue is highly correlated with qtt_invoices and 2 other fields | High correlation |
qtt_invoices is highly correlated with gross_revenue and 2 other fields | High correlation |
unique_products is highly correlated with gross_revenue and 1 other fields | High correlation |
unique_items is highly correlated with gross_revenue and 2 other fields | High correlation |
daily_purchase_rate is highly correlated with qtt_invoices | High correlation |
df_index is highly correlated with customer_id and 1 other fields | High correlation |
customer_id is highly correlated with df_index and 1 other fields | High correlation |
gross_revenue is highly correlated with qtt_invoices and 3 other fields | High correlation |
recency_days is highly correlated with df_index and 1 other fields | High correlation |
qtt_invoices is highly correlated with gross_revenue and 3 other fields | High correlation |
unique_products is highly correlated with gross_revenue and 2 other fields | High correlation |
unique_items is highly correlated with gross_revenue and 3 other fields | High correlation |
total_prod_returned is highly correlated with gross_revenue and 2 other fields | High correlation |
gross_revenue is highly skewed (γ1 = 23.1789984) | Skewed |
unique_items is highly skewed (γ1 = 25.19954694) | Skewed |
total_prod_returned is highly skewed (γ1 = 28.80267821) | Skewed |
df_index is uniformly distributed | Uniform |
df_index has unique values | Unique |
customer_id has unique values | Unique |
total_prod_returned has 4191 (73.6%) zeros | Zeros |
Reproduction
| Analysis started | 2022-08-22 21:26:48.797450 |
|---|---|
| Analysis finished | 2022-08-22 21:27:23.224265 |
| Duration | 34.43 seconds |
| Software version | pandas-profiling v3.2.0 |
| Download configuration | config.json |
| Distinct | 5693 |
|---|---|
| Distinct (%) | 100.0% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 2894.806605 |
| Minimum | 0 |
|---|---|
| Maximum | 5783 |
| Zeros | 1 |
| Zeros (%) | < 0.1% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 44.6 KiB |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 289.6 |
| Q1 | 1454 |
| median | 2897 |
| Q3 | 4339 |
| 95-th percentile | 5492.4 |
| Maximum | 5783 |
| Range | 5783 |
| Interquartile range (IQR) | 2885 |
Descriptive statistics
| Standard deviation | 1668.357134 |
|---|---|
| Coefficient of variation (CV) | 0.5763276661 |
| Kurtosis | -1.196233201 |
| Mean | 2894.806605 |
| Median Absolute Deviation (MAD) | 1443 |
| Skewness | -0.003582371647 |
| Sum | 16480134 |
| Variance | 2783415.527 |
| Monotonicity | Strictly increasing |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 0 | 1 | < 0.1% |
| 3888 | 1 | < 0.1% |
| 3864 | 1 | < 0.1% |
| 3863 | 1 | < 0.1% |
| 3862 | 1 | < 0.1% |
| 3861 | 1 | < 0.1% |
| 3860 | 1 | < 0.1% |
| 3859 | 1 | < 0.1% |
| 3858 | 1 | < 0.1% |
| 3857 | 1 | < 0.1% |
| Other values (5683) | 5683 |
| Value | Count | Frequency (%) |
| 0 | 1 | |
| 1 | 1 | |
| 2 | 1 | |
| 3 | 1 | |
| 4 | 1 | |
| 5 | 1 | |
| 6 | 1 | |
| 7 | 1 | |
| 8 | 1 | |
| 9 | 1 |
| Value | Count | Frequency (%) |
| 5783 | 1 | |
| 5782 | 1 | |
| 5781 | 1 | |
| 5780 | 1 | |
| 5779 | 1 | |
| 5778 | 1 | |
| 5777 | 1 | |
| 5776 | 1 | |
| 5775 | 1 | |
| 5774 | 1 |
| Distinct | 5693 |
|---|---|
| Distinct (%) | 100.0% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 16601.49587 |
| Minimum | 12347 |
|---|---|
| Maximum | 22709 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 44.6 KiB |
Quantile statistics
| Minimum | 12347 |
|---|---|
| 5-th percentile | 12700.6 |
| Q1 | 14289 |
| median | 16229 |
| Q3 | 18211 |
| 95-th percentile | 21732.8 |
| Maximum | 22709 |
| Range | 10362 |
| Interquartile range (IQR) | 3922 |
Descriptive statistics
| Standard deviation | 2808.146205 |
|---|---|
| Coefficient of variation (CV) | 0.1691501914 |
| Kurtosis | -0.8215450043 |
| Mean | 16601.49587 |
| Median Absolute Deviation (MAD) | 1962 |
| Skewness | 0.4411283657 |
| Sum | 94512316 |
| Variance | 7885685.106 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 17850 | 1 | < 0.1% |
| 21111 | 1 | < 0.1% |
| 16498 | 1 | < 0.1% |
| 13745 | 1 | < 0.1% |
| 15584 | 1 | < 0.1% |
| 21089 | 1 | < 0.1% |
| 21088 | 1 | < 0.1% |
| 21087 | 1 | < 0.1% |
| 21086 | 1 | < 0.1% |
| 15578 | 1 | < 0.1% |
| Other values (5683) | 5683 |
| Value | Count | Frequency (%) |
| 12347 | 1 | |
| 12348 | 1 | |
| 12349 | 1 | |
| 12350 | 1 | |
| 12352 | 1 | |
| 12353 | 1 | |
| 12354 | 1 | |
| 12355 | 1 | |
| 12356 | 1 | |
| 12357 | 1 |
| Value | Count | Frequency (%) |
| 22709 | 1 | |
| 22708 | 1 | |
| 22707 | 1 | |
| 22706 | 1 | |
| 22705 | 1 | |
| 22704 | 1 | |
| 22700 | 1 | |
| 22699 | 1 | |
| 22696 | 1 | |
| 22695 | 1 |
gross_revenue
Real number (ℝ≥0)
HIGH CORRELATIONHIGH CORRELATIONHIGH CORRELATIONHIGH CORRELATIONSKEWED| Distinct | 5447 |
|---|---|
| Distinct (%) | 95.7% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 1753.54654 |
| Minimum | 0.42 |
|---|---|
| Maximum | 279138.02 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 44.6 KiB |
Quantile statistics
| Minimum | 0.42 |
|---|---|
| 5-th percentile | 13.128 |
| Q1 | 236.09 |
| median | 612.78 |
| Q3 | 1569.11 |
| 95-th percentile | 5260.23 |
| Maximum | 279138.02 |
| Range | 279137.6 |
| Interquartile range (IQR) | 1333.02 |
Descriptive statistics
| Standard deviation | 7495.95906 |
|---|---|
| Coefficient of variation (CV) | 4.27474201 |
| Kurtosis | 705.9115845 |
| Mean | 1753.54654 |
| Median Absolute Deviation (MAD) | 478.74 |
| Skewness | 23.1789984 |
| Sum | 9982940.45 |
| Variance | 56189402.23 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 7.95 | 9 | 0.2% |
| 1.25 | 8 | 0.1% |
| 2.95 | 8 | 0.1% |
| 4.95 | 8 | 0.1% |
| 12.75 | 7 | 0.1% |
| 3.75 | 7 | 0.1% |
| 1.65 | 7 | 0.1% |
| 5.95 | 6 | 0.1% |
| 7.5 | 6 | 0.1% |
| 4.25 | 6 | 0.1% |
| Other values (5437) | 5621 |
| Value | Count | Frequency (%) |
| 0.42 | 1 | < 0.1% |
| 0.65 | 1 | < 0.1% |
| 0.79 | 1 | < 0.1% |
| 0.84 | 4 | |
| 0.85 | 3 | 0.1% |
| 1.07 | 1 | < 0.1% |
| 1.25 | 8 | |
| 1.44 | 1 | < 0.1% |
| 1.65 | 7 | |
| 1.69 | 1 | < 0.1% |
| Value | Count | Frequency (%) |
| 279138.02 | 1 | |
| 259657.3 | 1 | |
| 194550.79 | 1 | |
| 140450.72 | 1 | |
| 124564.53 | 1 | |
| 117379.63 | 1 | |
| 91062.38 | 1 | |
| 72882.09 | 1 | |
| 66653.56 | 1 | |
| 65039.62 | 1 |
| Distinct | 304 |
|---|---|
| Distinct (%) | 5.3% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 116.8703671 |
| Minimum | 0 |
|---|---|
| Maximum | 373 |
| Zeros | 37 |
| Zeros (%) | 0.6% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 44.6 KiB |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 3 |
| Q1 | 23 |
| median | 71 |
| Q3 | 200 |
| 95-th percentile | 338 |
| Maximum | 373 |
| Range | 373 |
| Interquartile range (IQR) | 177 |
Descriptive statistics
| Standard deviation | 111.6209282 |
|---|---|
| Coefficient of variation (CV) | 0.9550832341 |
| Kurtosis | -0.6403154021 |
| Mean | 116.8703671 |
| Median Absolute Deviation (MAD) | 61 |
| Skewness | 0.8153515696 |
| Sum | 665343 |
| Variance | 12459.23161 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 1 | 110 | 1.9% |
| 4 | 105 | 1.8% |
| 3 | 98 | 1.7% |
| 2 | 92 | 1.6% |
| 10 | 86 | 1.5% |
| 8 | 82 | 1.4% |
| 17 | 79 | 1.4% |
| 9 | 79 | 1.4% |
| 7 | 78 | 1.4% |
| 15 | 66 | 1.2% |
| Other values (294) | 4818 |
| Value | Count | Frequency (%) |
| 0 | 37 | 0.6% |
| 1 | 110 | |
| 2 | 92 | |
| 3 | 98 | |
| 4 | 105 | |
| 5 | 52 | |
| 7 | 78 | |
| 8 | 82 | |
| 9 | 79 | |
| 10 | 86 |
| Value | Count | Frequency (%) |
| 373 | 23 | |
| 372 | 23 | |
| 371 | 17 | |
| 369 | 4 | 0.1% |
| 368 | 13 | |
| 367 | 16 | |
| 366 | 15 | |
| 365 | 19 | |
| 364 | 11 | |
| 362 | 7 | 0.1% |
| Distinct | 56 |
|---|---|
| Distinct (%) | 1.0% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 3.471807483 |
| Minimum | 1 |
|---|---|
| Maximum | 206 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 44.6 KiB |
Quantile statistics
| Minimum | 1 |
|---|---|
| 5-th percentile | 1 |
| Q1 | 1 |
| median | 1 |
| Q3 | 4 |
| 95-th percentile | 11 |
| Maximum | 206 |
| Range | 205 |
| Interquartile range (IQR) | 3 |
Descriptive statistics
| Standard deviation | 6.814409585 |
|---|---|
| Coefficient of variation (CV) | 1.962784405 |
| Kurtosis | 301.9942725 |
| Mean | 3.471807483 |
| Median Absolute Deviation (MAD) | 0 |
| Skewness | 13.19072233 |
| Sum | 19765 |
| Variance | 46.43617799 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 1 | 2870 | |
| 2 | 825 | 14.5% |
| 3 | 502 | 8.8% |
| 4 | 394 | 6.9% |
| 5 | 237 | 4.2% |
| 6 | 173 | 3.0% |
| 7 | 138 | 2.4% |
| 8 | 98 | 1.7% |
| 9 | 69 | 1.2% |
| 10 | 55 | 1.0% |
| Other values (46) | 332 | 5.8% |
| Value | Count | Frequency (%) |
| 1 | 2870 | |
| 2 | 825 | 14.5% |
| 3 | 502 | 8.8% |
| 4 | 394 | 6.9% |
| 5 | 237 | 4.2% |
| 6 | 173 | 3.0% |
| 7 | 138 | 2.4% |
| 8 | 98 | 1.7% |
| 9 | 69 | 1.2% |
| 10 | 55 | 1.0% |
| Value | Count | Frequency (%) |
| 206 | 1 | |
| 199 | 1 | |
| 124 | 1 | |
| 97 | 1 | |
| 91 | 2 | |
| 86 | 1 | |
| 72 | 1 | |
| 62 | 2 | |
| 60 | 1 | |
| 57 | 1 |
| Distinct | 439 |
|---|---|
| Distinct (%) | 7.7% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 69.69295626 |
| Minimum | 1 |
|---|---|
| Maximum | 1786 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 44.6 KiB |
Quantile statistics
| Minimum | 1 |
|---|---|
| 5-th percentile | 2 |
| Q1 | 13 |
| median | 36 |
| Q3 | 85 |
| 95-th percentile | 241.4 |
| Maximum | 1786 |
| Range | 1785 |
| Interquartile range (IQR) | 72 |
Descriptive statistics
| Standard deviation | 101.7406736 |
|---|---|
| Coefficient of variation (CV) | 1.459841555 |
| Kurtosis | 43.87384045 |
| Mean | 69.69295626 |
| Median Absolute Deviation (MAD) | 28 |
| Skewness | 4.703075254 |
| Sum | 396762 |
| Variance | 10351.16467 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 1 | 278 | 4.9% |
| 2 | 149 | 2.6% |
| 3 | 112 | 2.0% |
| 10 | 101 | 1.8% |
| 5 | 97 | 1.7% |
| 9 | 96 | 1.7% |
| 8 | 93 | 1.6% |
| 6 | 93 | 1.6% |
| 11 | 92 | 1.6% |
| 7 | 90 | 1.6% |
| Other values (429) | 4492 |
| Value | Count | Frequency (%) |
| 1 | 278 | |
| 2 | 149 | |
| 3 | 112 | |
| 4 | 90 | 1.6% |
| 5 | 97 | 1.7% |
| 6 | 93 | 1.6% |
| 7 | 90 | 1.6% |
| 8 | 93 | 1.6% |
| 9 | 96 | 1.7% |
| 10 | 101 | 1.8% |
| Value | Count | Frequency (%) |
| 1786 | 1 | |
| 1766 | 1 | |
| 1322 | 1 | |
| 1118 | 1 | |
| 1109 | 1 | |
| 884 | 1 | |
| 817 | 1 | |
| 748 | 1 | |
| 730 | 1 | |
| 720 | 1 |
unique_items
Real number (ℝ≥0)
HIGH CORRELATIONHIGH CORRELATIONHIGH CORRELATIONHIGH CORRELATIONSKEWED| Distinct | 1838 |
|---|---|
| Distinct (%) | 32.3% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 948.5617425 |
| Minimum | 1 |
|---|---|
| Maximum | 196844 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 44.6 KiB |
Quantile statistics
| Minimum | 1 |
|---|---|
| 5-th percentile | 4 |
| Q1 | 106 |
| median | 316 |
| Q3 | 804 |
| 95-th percentile | 2913.2 |
| Maximum | 196844 |
| Range | 196843 |
| Interquartile range (IQR) | 698 |
Descriptive statistics
| Standard deviation | 4183.804245 |
|---|---|
| Coefficient of variation (CV) | 4.410682044 |
| Kurtosis | 948.0685665 |
| Mean | 948.5617425 |
| Median Absolute Deviation (MAD) | 253 |
| Skewness | 25.19954694 |
| Sum | 5400162 |
| Variance | 17504217.96 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 1 | 114 | 2.0% |
| 2 | 73 | 1.3% |
| 3 | 51 | 0.9% |
| 4 | 49 | 0.9% |
| 5 | 35 | 0.6% |
| 6 | 29 | 0.5% |
| 12 | 25 | 0.4% |
| 88 | 22 | 0.4% |
| 72 | 21 | 0.4% |
| 7 | 20 | 0.4% |
| Other values (1828) | 5254 |
| Value | Count | Frequency (%) |
| 1 | 114 | |
| 2 | 73 | |
| 3 | 51 | |
| 4 | 49 | |
| 5 | 35 | 0.6% |
| 6 | 29 | 0.5% |
| 7 | 20 | 0.4% |
| 8 | 18 | 0.3% |
| 9 | 7 | 0.1% |
| 10 | 17 | 0.3% |
| Value | Count | Frequency (%) |
| 196844 | 1 | |
| 80263 | 1 | |
| 77373 | 1 | |
| 69993 | 1 | |
| 64549 | 1 | |
| 64124 | 1 | |
| 63312 | 1 | |
| 58343 | 1 | |
| 57885 | 1 | |
| 50255 | 1 |
| Distinct | 1226 |
|---|---|
| Distinct (%) | 21.5% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 0.5473078999 |
| Minimum | 0.005449591281 |
|---|---|
| Maximum | 17 |
| Zeros | 0 |
| Zeros (%) | 0.0% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 44.6 KiB |
Quantile statistics
| Minimum | 0.005449591281 |
|---|---|
| 5-th percentile | 0.01104159896 |
| Q1 | 0.02492211838 |
| median | 1 |
| Q3 | 1 |
| 95-th percentile | 1 |
| Maximum | 17 |
| Range | 16.99455041 |
| Interquartile range (IQR) | 0.9750778816 |
Descriptive statistics
| Standard deviation | 0.5502787309 |
|---|---|
| Coefficient of variation (CV) | 1.00542808 |
| Kurtosis | 139.1642784 |
| Mean | 0.5473078999 |
| Median Absolute Deviation (MAD) | 0 |
| Skewness | 4.859773608 |
| Sum | 3115.823874 |
| Variance | 0.3028066817 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 1 | 2878 | |
| 2 | 47 | 0.8% |
| 0.0625 | 18 | 0.3% |
| 0.02777777778 | 17 | 0.3% |
| 0.02380952381 | 16 | 0.3% |
| 0.08333333333 | 15 | 0.3% |
| 0.09090909091 | 15 | 0.3% |
| 0.02941176471 | 14 | 0.2% |
| 0.03448275862 | 14 | 0.2% |
| 0.07692307692 | 13 | 0.2% |
| Other values (1216) | 2646 |
| Value | Count | Frequency (%) |
| 0.005449591281 | 1 | < 0.1% |
| 0.005464480874 | 1 | < 0.1% |
| 0.005479452055 | 1 | < 0.1% |
| 0.005494505495 | 1 | < 0.1% |
| 0.005586592179 | 2 | |
| 0.005602240896 | 1 | < 0.1% |
| 0.005617977528 | 2 | |
| 0.00566572238 | 1 | < 0.1% |
| 0.005681818182 | 2 | |
| 0.005698005698 | 3 |
| Value | Count | Frequency (%) |
| 17 | 1 | < 0.1% |
| 4 | 1 | < 0.1% |
| 3 | 5 | 0.1% |
| 2 | 47 | 0.8% |
| 1.142857143 | 1 | < 0.1% |
| 1 | 2878 | |
| 0.75 | 1 | < 0.1% |
| 0.6666666667 | 3 | 0.1% |
| 0.550802139 | 1 | < 0.1% |
| 0.5335120643 | 1 | < 0.1% |
| Distinct | 212 |
|---|---|
| Distinct (%) | 3.7% |
| Missing | 0 |
| Missing (%) | 0.0% |
| Infinite | 0 |
| Infinite (%) | 0.0% |
| Mean | 16.6597576 |
| Minimum | 0 |
|---|---|
| Maximum | 8004 |
| Zeros | 4191 |
| Zeros (%) | 73.6% |
| Negative | 0 |
| Negative (%) | 0.0% |
| Memory size | 44.6 KiB |
Quantile statistics
| Minimum | 0 |
|---|---|
| 5-th percentile | 0 |
| Q1 | 0 |
| median | 0 |
| Q3 | 1 |
| 95-th percentile | 38 |
| Maximum | 8004 |
| Range | 8004 |
| Interquartile range (IQR) | 1 |
Descriptive statistics
| Standard deviation | 166.7090233 |
|---|---|
| Coefficient of variation (CV) | 10.00668961 |
| Kurtosis | 1115.784459 |
| Mean | 16.6597576 |
| Median Absolute Deviation (MAD) | 0 |
| Skewness | 28.80267821 |
| Sum | 94844 |
| Variance | 27791.89845 |
| Monotonicity | Not monotonic |
Histogram with fixed size bins (bins=50)
| Value | Count | Frequency (%) |
| 0 | 4191 | |
| 1 | 169 | 3.0% |
| 2 | 150 | 2.6% |
| 3 | 105 | 1.8% |
| 4 | 89 | 1.6% |
| 6 | 78 | 1.4% |
| 5 | 61 | 1.1% |
| 12 | 52 | 0.9% |
| 7 | 44 | 0.8% |
| 8 | 43 | 0.8% |
| Other values (202) | 711 | 12.5% |
| Value | Count | Frequency (%) |
| 0 | 4191 | |
| 1 | 169 | 3.0% |
| 2 | 150 | 2.6% |
| 3 | 105 | 1.8% |
| 4 | 89 | 1.6% |
| 5 | 61 | 1.1% |
| 6 | 78 | 1.4% |
| 7 | 44 | 0.8% |
| 8 | 43 | 0.8% |
| 9 | 41 | 0.7% |
| Value | Count | Frequency (%) |
| 8004 | 1 | |
| 4427 | 1 | |
| 3768 | 1 | |
| 3332 | 1 | |
| 2878 | 1 | |
| 2022 | 1 | |
| 2012 | 1 | |
| 1776 | 1 | |
| 1594 | 1 | |
| 1535 | 2 |
Spearman's ρ
The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.
Pearson's r
The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.
Kendall's τ
Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.
Phik (φk)
Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here. A simple visualization of nullity by column.
Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.
First rows
| df_index | customer_id | gross_revenue | recency_days | qtt_invoices | unique_products | unique_items | daily_purchase_rate | total_prod_returned | |
|---|---|---|---|---|---|---|---|---|---|
| 0 | 0 | 17850 | 5391.21 | 372.0 | 34.0 | 21.0 | 1733.0 | 17.000000 | 40.0 |
| 1 | 1 | 13047 | 3232.59 | 56.0 | 9.0 | 105.0 | 1390.0 | 0.028302 | 35.0 |
| 2 | 2 | 12583 | 6705.38 | 2.0 | 15.0 | 114.0 | 5028.0 | 0.040323 | 50.0 |
| 3 | 3 | 13748 | 948.25 | 95.0 | 5.0 | 24.0 | 439.0 | 0.017921 | 0.0 |
| 4 | 4 | 15100 | 876.00 | 333.0 | 3.0 | 1.0 | 80.0 | 0.073171 | 22.0 |
| 5 | 5 | 15291 | 4623.30 | 25.0 | 14.0 | 61.0 | 2102.0 | 0.040115 | 29.0 |
| 6 | 6 | 14688 | 5630.87 | 7.0 | 21.0 | 148.0 | 3621.0 | 0.057221 | 399.0 |
| 7 | 7 | 17809 | 5411.91 | 16.0 | 12.0 | 46.0 | 2057.0 | 0.033520 | 41.0 |
| 8 | 8 | 15311 | 60767.90 | 0.0 | 91.0 | 567.0 | 38194.0 | 0.243316 | 474.0 |
| 9 | 9 | 16098 | 2005.63 | 87.0 | 7.0 | 34.0 | 613.0 | 0.024390 | 0.0 |
Last rows
| df_index | customer_id | gross_revenue | recency_days | qtt_invoices | unique_products | unique_items | daily_purchase_rate | total_prod_returned | |
|---|---|---|---|---|---|---|---|---|---|
| 5683 | 5774 | 22700 | 4839.42 | 1.0 | 1.0 | 55.0 | 1074.0 | 1.0 | 0.0 |
| 5684 | 5775 | 13298 | 360.00 | 1.0 | 1.0 | 2.0 | 96.0 | 1.0 | 0.0 |
| 5685 | 5776 | 14569 | 227.39 | 1.0 | 1.0 | 10.0 | 79.0 | 1.0 | 0.0 |
| 5686 | 5777 | 22704 | 17.90 | 1.0 | 1.0 | 7.0 | 14.0 | 1.0 | 0.0 |
| 5687 | 5778 | 22705 | 3.35 | 1.0 | 1.0 | 2.0 | 2.0 | 1.0 | 0.0 |
| 5688 | 5779 | 22706 | 5699.00 | 1.0 | 1.0 | 634.0 | 1747.0 | 1.0 | 0.0 |
| 5689 | 5780 | 22707 | 6756.06 | 0.0 | 1.0 | 730.0 | 2010.0 | 1.0 | 0.0 |
| 5690 | 5781 | 22708 | 3217.20 | 0.0 | 1.0 | 56.0 | 654.0 | 1.0 | 0.0 |
| 5691 | 5782 | 22709 | 3950.72 | 0.0 | 1.0 | 217.0 | 731.0 | 1.0 | 0.0 |
| 5692 | 5783 | 12713 | 794.55 | 0.0 | 1.0 | 37.0 | 505.0 | 1.0 | 0.0 |